On a Geometric Interpretation of the Positive Definite Secant Updates Bfgs and Dfp from the Wedderburn Formula
نویسندگان
چکیده
The BFGS update and the DFP update perhaps are respectively the most successful Hessian and inverse Hessian approximations for unconstrained minimization problems This paper describes a geometric meaning of these updates understood from the Wedderburn rank one reduction formula
منابع مشابه
Rank Modifications of Semi-definite Matrices with Applications to Secant Updates
The BFGS and DFP updates are perhaps the most successful Hessian and inverse Hessian approximations respectively for unconstrained minimization problems. This paper describes these methods in terms of two successive steps: rank reduction and rank restoration. From rank subtractivity and a powerful spectral result, the first step must necessarily result in a positive semidefinite matrix; and the...
متن کاملHistorical Development of the BFGS Secant Method and Its Characterization Properties by Joanna Maria Papakonstantinou
Historical Development of the BFGS Secant Method and Its Characterization Properties by Joanna Maria Papakonstantinou The BFGS secant method is the preferred secant method for finite-dimensional unconstrained optimization. The first part of this research consists of recounting the historical development of secant methods in general and the BFGS secant method in particular. Many people believe t...
متن کاملA Rank-One Reduction Formula and Its Applications to Matrix Factorizations
Dedicated to the Memory of Alston S Householder Abstract Let A R n denote an arbitrary matrix If x R and y R are vectors such that yAx then the matrix B A AxyA has rank exactly one less than the rank of A This Wedderburn rank one reduction formula is easy to prove yet the idea is so powerful that perhaps all matrix factorizations can be derived from it The formula also appears in places like th...
متن کاملOn averaging and representation properties of the BFGS and related secant updates
In this talk we present several representation theorems and averaging theorems for members of the difference class of secant updates introduced by Broadlie, Gourlay , and Greenstadt in 1973. The BFGS update is a well-known member of this difference class. We begin with the notion of an update kernel and use it to construct a new parametrization of the difference class of secant updates. Next we...
متن کاملThe modified BFGS method with new secant relation for unconstrained optimization problems
Using Taylor's series we propose a modified secant relation to get a more accurate approximation of the second curvature of the objective function. Then, based on this modified secant relation we present a new BFGS method for solving unconstrained optimization problems. The proposed method make use of both gradient and function values while the usual secant relation uses only gradient values. U...
متن کامل